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DETAILED ACTION 
Response to Amendment 

1 . The amendment filed on 8/9/2006 has been entered. 

2. Prosecution of this application has been reopened before the Examiner in view of 
appellant's request at page 1 where appellant requested to have prosecution reopened 
pursuant to 37 CFR 41 .39(b)(1 ) to address the new grounds of rejection raised in the 
Examiner's Answer. 

3. The amendments to claims 26-28 changing "computer-readable medium" to 
" tangible computer-readable medium" does not distinguish the claims from a signal 
because the specification does not give a definition for tangible computer-readable 
medium, thus, a signal is still covered by claims 26-28. New claims 39 and 40 are 
signal claims. 



Response to Arguments 

4. Applicants arguments filed on 8/9/2006 have been fully considered, but, they are 
not deemed to be persuasive. 

At page 13 in the paragraph concerning pages 3-15 of the Examiner's Answer 
applicant refers to the arguments presented in the Appeal Brief which were addressed 
in the Examiner's Answer. 

At page 13 in the paragraph concerning pages 16-23 of the Examiner's Answer 
applicant refers to the new grounds of rejection made in the Examiner's Answer. 
Continuing from page 13 to page 20 applicants present various arguments concerning 
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the 35 USC 101 non-statutory made in the Examiner's Answer. These arguments are 
not persuasive for the following reasons. 

At pages 13 and 14 applicant contends the claims present a "useful, concrete, 
and tangible result" and the "video" and "video processing" are not inherently abstract 
concepts. However, as noted in the Examiner's Answer the specification gives these 
terms a very broad meaning, see speciation at paragraphs [0018] and [0019], by having 
the term video to cover all forms of images both real and virtual and the term video 
processing to be any manipulation of video. Thus, the claims do not claim "_a_ useful, 
concrete, tangible result" (emphasis added). 

At pages 15-18 applicant contends that a carrier wave is statutory. However, in 
view of the Interim guidelines this argument is incorrect. In response to this rejection 
applicant amended claims 26-28 and presented new claims 39 and 40. Applicants 
amendments to claims 26-28 changing "computer-readable medium" to " tangible 
computer-readable medium" does not distinguish the claims from a signal because the 
specification does not give a definition for tangible computer-readable medium. Thus, 
applicants arguments are not persuasive and amended claims 26-28 remain as claims 
covering the media discussed in applicants paragraph [0014] claiming signals and new 
claims 39 and 40 are signal claims. 

From the last full paragraph on page 18 to page 20 applicant asserts the claims 
do not preempt all substantial uses of the underlying abstract mathematical concept. 
Applicant asserts in the paragraph spanning pages 18 and 19 the claims do not prevent 
use of underlying abstract mathematical concepts to non-video sources, however, 
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applicants specification, see paragraph [0018], makes clear the claimed term "video" is 
intended to cover many sources not normally considered to be video, thus, applicants 
claimed "video" does cover the argued "non-video sources". Applicant further asserts in 
the first full paragraph on page 19 the underlying abstract mathematical concepts are 
being applied to a specific use of extraction of overlays from video. However, the 
underlying mathematical concepts are for extracting overlays from applicants abstractly 
defined "video", thus, these underlying mathematical concepts are being claimed to be 
applied to all types of images capable of having an overlay. Therefore, the claims do 
preempt all substantial uses of the underlying mathematical concepts. 

5. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Wilf el al., US Patent No. 7,184,100; Hannah et al., US Patent No. 7,146,008; 
and Kazui et al., US Patent No. 5,920,650 each teach extracting a graphical overlay 
from video to produce a video without the graphical overlay. 

6. The rejection set forth in the Examiner's Answer is reproduced below with 
modifications to reflect the amendments to claims 26-28 and the addition of new claims 
39 and 40. 
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Claim Rejections - 35 USC § 102 

7. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(a) the invention was known or used by others in this country, or patented or described in a printed 
publication in this or a foreign country, before the invention thereof by the applicant for a patent. 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

8. Claims 1-3, 22, 23, 26, 27, and 39 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Byung Tae Chun, Younglae Bae, Tai-Yun Kim, Text Extraction in Videos 
using Topographical Features of Characters, August 22-25, 1999, IEEE, vol. 2, pages 
1126-1130. 

This article teaches extracting text from video by two main steps of extracting 
candidate areas using topographical features and then verifying text is in those areas. 
Section 3.1 discusses extracting candidate area for text area and section 3.2 discusses 
verification of candidates of text area. Section 2 discusses character regions having 
some fixed colors and sizes, and are densely located in the horizontal direction, as 
shown in Fig. 2. The colors and shapes are not regular in the background. Thus, text in 
the actual video will have movement and will likely have a size different then Chun's 
algorithm's text size. Therefore, Chun recognized the difference between original 
video with text and text overlayed onto the original video having original text and 
teaches to one of ordinary skill in the art to discriminate between the original text and 
the overlayed text . 
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A detailed analysis of the claims follows. 
Claim 1: 

Chun teaches a method of video processing to be performed by video processing 
equipment, the method (See introduction.) comprising: 

extracting a pre-existing static overlay present in a video sequence (See the 
introduction, paragraph 1 which discusses text appearing in video such as news where 
is often used to identify people, see figure 2, and to place identifying marks, see the 
upper left and lower right corners of figure 2. See section 5 which discusses detecting 
captions which are stationary text.) said extracting comprising: 

detecting at least one potential overlay in the video sequence (Section 3. 1 
discusses extracting candidate area for text area.); and 

verifying that each at least one potential overlay is an actual static overlay that 
was previously added to an original video sequence to obtain said video sequence 
(Section 3.2 discusses verification of candidates of text area. Section 2 discusses 
character regions having some fixed colors and sizes, and are densely located in the 
horizontal direction, as shown in Fig. 2. The colors and shapes are not regular in the 
background. Thus, text in the actual video will have movement and will likely have a 
s/ze different then Chun's algorithm's text size. Therefore, Chun recognized the 
difference between original video with text and text overlayed onto the original video 
having original text and teaches to one of ordinary skill in the art to discriminate 
between the original text and the overlayed text . Captions are usually static. Also 
section 5 discusses "caption area" which implies a stationary area. Thus this article 
detects a static text overlay in the caption area.). 
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Claim 2: 

Chun teaches the method of claim 1, further comprising the step of post- 
processing at least one actual static overlay to remove extraneous pixels (Figure 1 
shows the post processing step of removing noise. Noise comprises extraneous pixels 
such as non-character regions inside the character regions, see section 3.3, thus, Chun 
teaches removing extraneous pixels.). 

Claim 3: 

Chun teaches the method of claim 2, wherein said step of post-processing 
comprises the steps of: 

computing a variance for each pixel of the at least one actual static overlay 
(Section 3.3 discusses removing noise by using Isodata color clustering. The verified 
actual overlay area is analyzed to determine the color of each pixel to cluster the pixels 
in the overlay area.)] and 

comparing the variance with a threshold to determine whether or not the pixel 
should be removed as an extraneous pixel (The size of the color clusters are compared 
and if they are too small the cluster is removed which removes the pixels forming each 
cluster.). 

Claim 22: 

Chun teaches the method of Claim 1 , wherein said step of detecting comprises 
the step of: 

performing template matching to determine the presence of a potential overlay 
(Section 2 and 3. 1 discusses using the topological features of characters to determine 
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the presence of a potential overlay. Topological features of characters define a 
template for each character or groups of characters.). 

Claim 23: 

Chun teaches the method of claim 22, wherein said step of detecting further 
comprises the step of: 

determining a template (The paragraph before section 3 discusses determine n 
and alpha. The values of n and alpha form a template.) to be used in said step of 
performing template matching. 

Claim 26: 

Chun teaches a tangible computer readable medium containing computer- 
executable code for causing a computer to implement the method of claim 1 (Chun 
discusses using a computer to perform the text extraction in section 4. The discussed 
Pentium 4 computer using a program written in Visual C++ Ver. 5.0 has the program 
stored in a computer readable medium, the disk drive and RAM.). 

Claim 27: 

Chun teaches a computer system comprising: 

a computer (Chun discusses using a Pentium 4 computer to perform the text 
extraction in section 4.)\ and 
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a tangible computer readable medium coupled to said computer and containing 
computer-executable code for causing a computer to implement the method of claim 1 
(Chun discusses using a computer to perform the text extraction in section 4. The 
discussed Pentium 4 computer using a program written in Visual C++ Ver. 5.0 has the 
program stored in a computer readable medium, the disk drive and RAM). 

Claim 39: 

Chun teaches a method of processing video to extract at least one overlay, the 
method comprising: 

receiving a carrier wave carrying computer-readable electronic data representing 
computer-executable code that, when executed by a computer, causes the computer to 
implement the method of Claim 1 because when the computer reads the Visaul C++ 
program the memory will send an electrical signal comprising a carrier wave through the 
computer's local bus to the CPU for execution by the CPU. 

9. Claims 1 , 22-27, and 35-39 are rejected under 35 U.S.C. 102(a) as being 
anticipated by S. Antani, D. Crandall, R. Kasturi, Robust Extraction of Text in Video, 
Sept 3-7, 2000, IEEE, vol. 1 , pages 831-834. 

This article teaches detecting static overlays on video by performing a frame to 
frame comparison of the video. In the section 3, second paragraph at lines 7-1 1 
"artificial caption text" and "scene text occurring naturally in a video frame" is discussed. . 
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The Antani article discusses the video having temporal information while the 
overlayed characters have less temporal information and the overlayed characters are 
contrasted by a changing background. Abstract and section 4. Text in the original video 
will more likely have movement from frame to frame. Applicant's arguments made 
reference to a stop sign example would most likely be part of a moving background 
while text overlayed onto the video will most likely be stationary. As discussed above 
Anatani on page 833 second column lines 11-12 states the detected text will be 
stationary. Therefore, Antani recognized the difference between original video with text 
and text overlayed onto the original video and teaches to one of ordinary skill in the art 
to discriminate between the original text and the overlayed text. 

A detailed analysis of the claims follows. 
Claim 1: 

Antani teaches a method of video processing to be performed by video 
processing equipment, the method (See introduction.) comprising: 

extracting a pre-existing static overlay present in a video sequence (See the 
introduction, paragraph 1 second column which discusses text appearing in video.) said 
extracting comprising: 

detecting at least one potential overlay in the video sequence (Section 2 
discusses three stages, the detection, localization, and segmentation stages. The 
detection stage detects a potential overlay.)] and 

verifying that each at least one potential overlay is an actual static overlay that 
was previously added to an original video sequence to obtain said video sequence 
(Section 2 discusses the localization stage which uses many methods to localize the 
text. Section 2 discusses using many different localization algorithms whose outputs are 
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fused in the spatio-temporal decision fusion module over multiple frames to verify that a 
potential text is text. Section 2 also discusses using a tracking stage, this would 
inherently verify the potential text is an actual text. The Abstract and section 4 
discusses the video having temporal information while the overtayed characters have 
less temporal information and the overtayed characters are contrasted by a changing 
background. Text in the original video will more likely have movement from frame to 
frame. Applicant's arguments made reference to a stop sign example would most likely 
be part of a moving background while text overtayed onto the video will most likely be 
stationary. Therefore, Antani recognized the difference between original video with text 
and text overtayed onto the original video and teaches to one of ordinary skill in the art 
to discriminate between the original text and the overtayed text.). 

Claim 22: 

Antani teaches the method of Claim 1 , wherein said step of detecting comprises 
the step of: 

performing template matching to determine the presence of a potential overlay 
(Section 2 discusses the detection of potential overlay in the detection stage which 
consists of many different localization algorithms whose outputs are fused in the spatio- 
temporal decision fusion module over multiple frames. In order to determine if text 
exists then predefined knowledge of the text is compared with the current image to 
determine if a match exists. Predefined knowledge of the text is a template.). 



Application/Control Number: 09/935,610 Page 12 

Art Unit: 2628 

Claim 23: 

Antani teaches the method of claim 22, wherein said step of detecting further 
comprises the step of: 

determining a template to be used in said step of performing template matching 
(Inherently at some time the templates used by the program were determined.).. 

Claim 24: 

Antani teaches the method of claim 22, wherein said step of verifying comprises 
the steps of: 

performing frame-to-frame correlation of said potential overlay (Section 2 
discusses using many different localization algorithms whose outputs are fused in the 
the spatio-temporal decision fusion module over multiple frames.)] and 

comparing a result of the frame-to-frame correlation with a threshold to determine 
if the potential overlay is an actual static overlay or not (In order to determine if text 
exists then predefined knowledge of the text is compared with the current image to 
determine if a match exists. Predefined knowledge of the text is a template of 
thresholds.). 

Claim 25: 

Antani teaches the method of claim 24, wherein said step of performing frame-to- 
frame correlation (See the discussion above for claim 24.) comprises the steps of: 
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forming a mean square error over a set of frames from said video sequence, 
averaged over all of the pixels in said potential overlay (This claim does not claim a use 
for the mean square error, thus, a reference that forms a mean square error over a set 
of frames teaches the claim. This claim does not claim how the mean square error is 
formed, thus, a reference that inherently forms the error teaches the claim. The 
specification in paragraph 0039 sets forth a specific formula for calculating the mean 
square error, however, the claim only broadly claims how the claimed mean square 
error is calculated. Although the claims are interpreted in light of the specification, 
limitations from the specification are not read into the claims. See In re Van Geuns, 988 
F.2d 1181, 26 USPQ2d 1057 (Fed. Cir. 1993). The disclosed formula determines the 
average difference in intensities between a current frame and a subsequent frame. 
Antani inherently forms the mean square error since Antani in the localization stage 
fuses over several frames decisions from many localization algorithms which inherently 
has determined the average difference in intensities between frames in order to 
determine if text exists.). 

Claims 26 and 27: 

Inherently the algorithm of Antani is performed by a computer having a tangible 
computer readable medium containing computer-executable code for causing a 
computer to implement the claimed steps. 
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Claim 35: 

Antani teaches a method of processing video to be performed by video 
processing equipment, the method, comprising: 

extracting a pre-existing static graphical (In the section 3 second paragraph lines 
7-1 1 "artificial caption text" and "scene text occurring naturally in a video frame" is 
discussed. Artificial caption text is graphical because graphical includes many objects 
including text.) overlay present in a video sequence, said extracting comprising: 

^detecting at least one potential overlay in a the video sequence (Section 2 
discusses three stages, the detection, localization, and segmentation stages. The 
detection stage detects a potential overlay.), said detecting comprising the step of: 
performing template matching (Section 2 discusses the detection of potential overlay in 
the detection stage which consists of many different localization algorithms whose 
outputs are fused in the spatio-temporal decision fusion module over multiple frames. 
In order to determine if text exists then predefined knowledge of the text is compared 
with the current image to determine if a match exists. Predefined knowledge of the text 
is a template.)] and 

verifying that each at least one potential overlay is an actual static overlay that 
was previously added to an original video sequence to obtain said video sequence 
(Section 2 discusses the localization stage which uses many methods to localize the 
text. Section 2 discusses using many different localization algorithms whose outputs are 
fused in the the spatio-temporal decision fusion module over multiple frames to verify 
that a potential text is text. Section 2 also discusses using a tracking stage, this would 
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inherently verify the potential text is an actual text. The Abstract and section 4 
discusses the video having temporal information while the overlayed characters have 
less temporal information and the overlayed characters are contrasted by a changing 
background. Text in the original video will more likely have movement from frame to 
frame. Applicant's arguments made reference to a stop sign example would most likely 
be part of a moving background while text overlayed onto the video will most likely be 
stationary. Therefore, Antani recognized the difference between original video with text 
and text overlayed onto the original video and teaches to one of ordinary skill in the art 
to discriminate between the original text and the overlayed text.), said verifying 
comprising the step of: 

performing frame-to-frame correlation of a potential overlay determined by said 
detecting step (Section 2 discusses using many different localization algorithms whose 
outputs are fused in the spatio-temporal decision fusion module over multiple frames.). 

Claim 36: 

Antani teaches the method of Claim 35, wherein said step of detecting further 
comprises the step of: 

determining a template to be used in said step of performing template matching 
{Inherently at some time the templates used by the program were determined.). 
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Claim 37: 

Antani teaches the method of Claim 36, wherein said step of determining a 
template comprises the step oft 

performing addition or frame-by-frame subtraction of video frames (This claim 
does not define the specifics of the addition of video frames or the frame-by-frame 
subtraction of video frames. This claim does not state if pixel values are added or frame 
numbers are added or if as in Antani the results of many frame analyses are fused or 
added or subtracted.). This step does not state what function the addition or subtraction 
performs, thus, the scope of the claim is broad and is met by Antani when a template for 
detection stage is determined since the claim does not claim when the template is 
determined and when the addition or subtraction is performed. Therefore in this 
comprising claim all that is needed is for the reference to teach the claimed steps. 

Claim 38: 

Antani teaches the method of Claim 36, wherein said step of determining a 
template comprises the steps of: 

segmenting video frames into foreground and background objects (Text is 
foreground and video is the background. See the Abstract at the next to last and last 
sentences. Section 1 second paragraph lines 8-9.); 

performing correlation tracking to determine if any foreground object remains in the 
same absolute location in each video frame (Section 2 discusses using many different 
localization algorithms whose outputs are fused in the spatio-temporal decision fusion 
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module over multiple frames to verify that a potential text is text. In the last sentence of 
section 2 the article teaches due to the fact that text lasts over several frames the text 
may be determined. The Abstract at the last sentence teaches determining if the text is 
static). This step does not state what function the segmenting and correlation tracking 
performs, thus, the scope of the claim is broad and the claim does not claim when the 
template is determined and when the segmenting and correlation tracking is performed. 
Therefore in this comprising claim all that is needed is for the reference to teach the 
claimed steps. 

Claim 39: 

^Chtrrr teaches a method of processing video to extract at least one overlay, the 
method comprising: 

receiving a carrier wave carrying computer-readable electronic data representing 
computer-executable code that, when executed by a computer, causes the computer to 
implement the method of Claim 1 because when the computer reads the Vioou l 0 1 i 
program the memory will send an electrical signal comprising a carrier wave through the 
computer's local bus to the CPU for execution by the CPU. 

Claim Rejections - 35 USC § 101 

10. Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and 
requirements of this title. 

1 1 . Claims 1-40 are rejected under 35 U.S.C. 101 as being directed to nonstatutory 
subject matter. This application appears to manifest a useful, concrete, and tangible 
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result, see paragraphs 0004-0007, however, these claims do not. These claims are 

directed to abstract method of processing video to determine if a static overlay exists, 

however, they do not claim a useful, concrete, and tangible result of this abstract 

determination. The specification broadly defines many of the claimed terms in a 

dictionary at paragraphs 13-20. The term "video" is defined in paragraph 0018 as: 

[0018] "Video" refers to motion pictures represented in analog and/or digital form. 
Examples of video include television, movies, image sequences from a camera or other 
observer, and computer-generated image sequences. These can be obtained from, for 
example, a live feed, a storage device, a firewire interface, a video digitizer, a computer 
graphics engine, or a network connection. 



The term "video processing" is defined in paragraph 0019 as: 

[0019] "Video processing" refers to any manipulation of video, including, for example, 
compression and editing. 



The term "computer-readable medium" is defined in paragraph 0014 as: 

[0014] A "computer-readable medium" refers to any storage device used for storing data 
accessible by a computer. Examples of a computer-readable medium include: a 
magnetic hard disk; a floppy disk; an optical disk, like a CD-ROM or a DVD; a magnetic 
tape; a memory chip; and a carrier wave used to carry computer-readable electronic 
data, such as those used in transmitting and receiving e-mail or in accessing a network. 



State Street Bank & Trust Co. v. Signature Financial Group Inc. (CA FC) 47 USPQ2d 

1596,. 1603 (7/23/1998). AT&T Corp. v. Excel Communications Inc. (CA FC) 50 

USPQ2d 1447. On page 1 603 first paragraph the CAFC wrote in State Street: 

Under Benson , this may have been a sufficient indicium 
of nonstatutory subject matter. However, after Diehr and 
Alappat , the mere fact that a claimed invention involves 
inputting numbers, calculating numbers, outputting 
numbers, and storing numbers, in and of itself, would not 
render it nonstatutory subject matter, unless, of course, its 
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operation does not produce a "useful, concrete and tangible 
result." Alappat , 33 F.3d at 1544, 31 USPQ2d at 1557. 7 



On page 1603 paragraph labeled [4] the CAFC wrote: 

[4] The question of whether a claim encompasses statutory 
subject matter should not focus on which of the four 
categories of subject matter a claim is directed to 9 
process, machine, manufacture, or composition of matter- 
but rather on the essential characteristics of the subject 
matter, in particular, its practical utility. Section 101 specifies 
that statutory subject matter must also satisfy the other 
"conditions and requirements" of Title 35, including novelty, 
nonobviousness, and adequacy of disclosure and notice- 
See In re Warmerdam , 33 F.3d 1354, 1359, 31 
USPQ2d 1754, 1757-58 (Fed. Cir. 1994). 



The reviewing court, the U.S. Court of Appeals for the Federal Circuit, has 
recognized that "certain types of mathematical subject matter, standing alone, represent 
nothing more than abstract ideas until reduced to some type of practical application, i.e., 
'a useful, concrete and tangible result. 1 " State St. Bank & Trust Co. v. Siqnature Fin. 
Group, Inc. 149 F.3d 1368, 1373, 47 USPQ2d 1596, 1600-01 (Fed. Cir. 1998) (citing In 
re Alappat, 33 F.3d 1526, 1544, USPQ2d 1545, 1557 (Fed. Cir. 1994) (en banc)). This 
test derives from the following statement in Alappat: "This (claimed invention) is not a 
disembodied mathematical concept which may be characterized as an 'abstract idea, 
but rather a specific machine to produce a useful, concrete, and tangible result." 
(Emphasis added.) Alappat, 33 F.3d at 1544, 31 USPQ2d at 1557. Alappat, Arrhvthmia 
Research Technoloqv Inc. v. Corazonix Corpw 958 F.2d 1053, 22 USPQ2d 1033 (Fed. 
Cir. 1992), State Street, and AT&T v. Excel Communications, Inc. 172 F.3d 1352, 50 
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USPQZd 1447 (Fed. Cir. 1999) all involved transformation of data by a machine. The 
Federal Circuit specifically held that transformation of data representing some real world 
quantity into a useful, concrete, and tangible result (a waveform in Alaopat, an 
electrocardiograph signals from a patient's heartbeat in Arrhvthmia, or discrete dollar 
amounts in State Street) by a machine was a practical application of a mathematical 
algorithm, formula, or calculation that produced "a useful, concrete and tangible result," 
and that a method of applying a PIC indicator "value through switching and recording 
mechanisms to create a signal useful for billing purposes," AT&T, F.3d at 1358, 50 
USPQ2d at 1452, a machine-implemented process, was "a useful, concrete, tangible 
result." See Lundqren, 76 USPQ2d at 141 1-16 (APJ Barrett, concurring-in-part and 
dissenting-in-part) (noting that the State Street test so far is limited to machines and 
machine-implemented processes). The test in Alappat may derive from the definition of 
"machine"': "The term machine includes every mechanical device or combination of 
mechanical powers and devices to perform some function and produce a certain effect 
or result." Corning v. Burden, 56 U.S. 252, 267 (1854). It was not explained where the 
useful, concrete and tangible" terms come from or how these are defined. 

The State Street test applies once the claimed subject matter has been 
determined to fall within one of the statutory categories of 35 U.S.C. 5 101. The U.S. 
Patent and Trademark Office recently issued Interim Guidelines for Examination of 
Patent Applications for Patent Subject Matter Eligibility (Interim Guidelines), 1300 Off. 
Gaz. Patent and Trademark Off. (O.G.) 142 (Nov. 22, 2005), which state that the 
practical application that produces a "useful, concrete and tangible result" must be 
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contained in the claims/id. at 146. Thus, it is not sufficient that a mathematical algorithm 
performed on a computer is capable of a practical application: the application must be 
contained in the claims. Interim Guidelines for Examination of Patent Applications for 
Patent Subject Matter Eligibility published on the USPTO website on October 26, 2005, 
at 

http://www.uspto.gov/web/offices/pac/dapp/opla/preoanotice/quidelines1 01 20051 026. p 
df 

and published in the OG 22Nov2005 

http://www.uspto.gov/web/offices/com/sol/og/2005/week47/patgupa.htm . 

The claims are directed to "A method of video processing to be performed by 
video processing equipment" and "extracting a pre-existing static overlay present in a 
video sequence"(Claims 1-25 and 29-38), "a tangible computer readable medium 
containing computer executable cod for causing a computer to implement the method of 
claiml" (Claim 26), "a computer system comprising: a computer; and a tangible 
computer readable medium containing computer executable cod for causing a computer 
to implement the method of claiml" (Claim 27), "a computer system comprising: a 
computer; a tangible computer readable medium containing computer executable cod 
for causing a computer to implement the method of claiml ; an external processor, in 
communication with said computer, on which is performed the step of neural network 
processing" (Claim 28); "receiving a carrier wave carrying computer-readable electronic 
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data... to implement the method of claim 1" (Claim 39); and "receiving a carrier wave 
carrying computer-readable electronic data... to implement the method of claim 4" 
(Claim 40). These limitations are sufficient to put the claimed subject matter within one 
of the categories of 35 USC 1 01 , so as to invoke the State Street test. Although the 
specification, at paragraphs 0004-0007, discloses a variety of applications, none of 
these applications are specifically recited in the claims. The specification further defines 
the claimed terms "video" and "video processing" very broadly. The claimed term 
"video" is defined as "Examples of video include television, movies, image sequences 
from a camera or other observer, and computer-generated image sequences". The 
claimed term "video processing" is defined as "any manipulation of video, including, for 
example, compression and editing". Therefore, the claims are directed to abstract video 
processing (any manipulation of video) and to the mathematical procedure of " 
extracting a pre-existing static overlay present in a video sequence" without claiming 
any practical application or useful, concrete and tangible result of the extraction. This 
appears to be one type of claim that the Federal Circuit would still consider to be 
unpatentable and is rejected for the reasons stated in the Interim Guidelines, 1300 O.G. 
at 146. Possibly it would take very little to convert the claims to statutory subject 
matter, but, under the present USPTO Interim Guidelines, the claims are considered to 
be nonstatutory. 
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Claims 26, 39, and 40: 

These claims are additionally nonstatutory in view the Interim Guidelines for 
Examination of Patent Applications for Patent Subject Matter Eligibility published on the 
USPTO website on October 26, 2005, 

http://www.uspto.gov/web/offices/pac/dapp/opla/preognotice/guidelines1 01_20051026.pdf 
and published in the OG 22Nov2005 

http://www.uspto.gov/web/offices/com/sol/og/2005/week47/patqupa.htm ) because they 

claim a computer readable medium which in view of the specification is a carrier wave. 

The term "computer-readable medium" is defined in paragraph 0014 as: 

[0014] A "computer-readable medium" refers to any storage device used for storing data 
accessible by a computer. Examples of a computer-readable medium include: a 
magnetic hard disk; a floppy disk; an optical disk, like a CD-ROM or a DVD; a magnetic 
tape; a memory chip; and a carrier wave used to carry computer-readable electronic 
data, such as those used in transmitting and receiving e-mail or in accessing a network. 

These claims claim carrier wave signals as a computer readable medium because 

applicants paragraph 0014 defines computer readable medium as carrier wave. Claim 

26 claims a carrier wave for causing a computer to implement the method of claim 1 

even in light of the addition of the term "tangible" to claim 26 because applicants 

specification does not define the term "tangible". Claims 39 and 40 are clearly directed 

to carrier waves. See applicants remarks at page 18. In ANNEX IV Computer-Related 

Nonstatutory Subject Matter of the Interim guidelines a signal is held to be nonstatutory 

subject matter and since applicants carrier wave is a signal then these claims are 

nonstatutory. Applicant should note that amendments to the specification, such as 
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deletion, may introduce new matter into the specification. Thus, an appropriate 
amendment to the claims is necessary to make the claims statutory. 



Claims 1-40: 

These claims are additionally nonstatutory in view of the Interim Guidelines for 
Examination of Patent Applications for Patent Subject Matter Eligibility at page 23 
because they preempt all general applications of the computer program and its 
mathematical formula. As discussed above claims 26, 39, and 40 are computer 
program claims which is evidence that method claims 1-25 and 29-38 as well as 
computer system claims 27 and 28 are based upon a computer program and in view of 
appellants specification, see paragraphs 0014, 0018, 0019, and 0064, claims 1-40 
cover computer programs, software, and mathematical formula and claims 1-40 cover 
all substantial applications of the computer program, the software, and the mathematical 
formula. Paragraphs 0019 and 0064 state: 

[0019] "Video processing" refers to any manipulation of video, including, for example, 
compression and editing. 

[0064] It is contemplated that the methods for extracting textual and graphical overlays 
may be embodied as software on a computer-readable medium and/or as a computer 
system running such software (which would reside in a computer-readable medium, 
either as part of the system or external to the system and in communication with the 
system). It may also be embodied in a form such that neural network or other 
processing is performed on a processor external to a computer system (and in 
communication with the computer system), e.g., a high-speed signal processor board, a 
special-purpose processor, or a processing system specifically designed, in hardware, 
software, or both, to execute such processing. 

Page 23 of the Guidelines discusses: 

Even when a claim applies a mathematical formula, for example, as part of a seemingly 
patentable process, the examiner must ensure that it does not in reality "seekQ patent 
protection for that formula in the abstract." Diehr, 450 U.S. at 191 , 209 USPQ at 10. 
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"Phenomena of nature, though just discovered, mental processes, abstract intellectual 
concepts are not patentable, as they are the basic tools of scientific and technological 
work." Benson, 409 U.S. at 67, 175 USPQ at 675. One may not patent a process that 
comprises every "substantial practical application" of an abstract idea, because such a 
patent "in practical effect would be a patent on the [abstract idea] itself." Benson, 409 
U.S. at 71-72, 175 USPQ at 676; cf. Diehr, 450 U.S. at 187, 209 USPQ at 8 (stressing 
that the patent applicants in that case did "not seek to pre-empt the use of [an] 
equation," but instead sought only to "foreclose from others the use of that equation in 
conjunction with all of the other steps in their claimed process"). "To hold otherwise 
would allow a competent draftsman to evade the recognized limitations on the type of 
subject matter eligible for patent protection." Diehr, 450 U.S. at 192, 209 USPQ at 10. 
Thus, a claim that recites a computer that solely calculates a mathematical formula (see 
Benson) or a computer disk that solely stores a mathematical formula is not directed to 
the type of subject matter eligible for patent protection. 



Thus, appellants claims when read in light of the specification preempt all substantial 
uses of the computer program, the software, and the mathematical formula forming 
applicants invention. 

1 2. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 
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1 3. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jeffery A Brier whose telephone number is (571 ) 272- 
7656. The examiner can normally be reached on M-F from 7:00 to 3:30. If attempts to 
reach the examiner by telephone are unsuccessful, the examiner's supervisor, Michael 
Razavi, can be reached at (571) 272-7664. The fax phone Number for the organization 
where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 




Jeffery A Brier 
Primary Examiner 
Division 2628 



